Properties of Control Chart Zone Tests 

By S. W. ROBERTS 

(Manuscript received September 10, 1957) 

This paper is concerned with the statistical properties of tests com- 
posed of the standard control chart test supplemented by one or more 
tests for runs of points in various zones into which the control chart is 
partitioned. The basic properties of the resultant tests, called zone tests, are 
illustrated graphically. A procedure for determining the properties of many 
zone tests of practical interest is described. 

I. INTRODUCTION 

l.l General 

In using an X control chart to maintain control of a process average, 
we periodically measure n units of the product and plot the average 
measurement X„ on the control chart in its chronological position. The 
control chart presents a pictorial summary of production history that is 
useful in: (a) detecting changes in the process average, and (b) pro- 
viding clues to the causes of such changes. Various run tests have proved 
useful in application (b). 1 Most of the literature on run theory pertains 
to this application. There are tests for runs up and for runs up and down; 
there are tests for the number of runs and for the lengths of runs. The 
control chart is particularly suitable for run tests. We shall consider the 
use of a particular type of run test in application (a). 

In application (a), as each point is plotted we decide whether or not 
to look for trouble (to take action to eliminate the cause of the change 
in the process average). Using the standard control chart test, 2 ' 3 we look 
for trouble if a point falls in a zone outside of two control limits sym- 
metrically placed on either side of a line representing the nominal proc- 
ess average. The control limit_s, called the 3<r (3-sigma) limits, are placed 
at Xo ± 3(oV\/n), where AY and a are the nominal process average 
and standard deviation, respectively, and n is the sample size, or num- 
ber of units of product measured for each point. We shall assume that 
AY and a' are known, and that a' remains fixed. 
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In using a statistical test to decide at each point whether or not to 
look for trouble, we are subject to two types of errors: 

(1) We make Type 1 errors when we decide to look for trouble when 
in fact none is present. 

(2) We make Type 2 errors when we decide not to look for trouble 
when trouble is actually present. 

Few Type 1 errors are made when the standard control chart test is 
used — an average of about one point in 370 falls outside of the 3«r limits 
when the process average is at its nominal level. Type 2 errors occur at 
consecutive points following a change until the test used indicates that 
a change has occurred. Small changes may result in long sequences of 
Type 2 errors because the probability of a point falling outside of the 
3<r limits may be small, though larger than it was when the process aver- 
age was at its nominal level. This definition of the two types of errors 
makes a sharp distinction between the presence and absence of trouble — 
a distinction more theoretical than practical — in order to simplify the 
exposition of the subject. 

Experience indicates that, in general, the standard control chart test 
maintains an economic balance between the two types of errors in a 
wide range of industrial applications (Reference 2, pp. 276-7; Reference 
3, p. 11). However, other tests may be more attractive economically in 
applications where early detection of relatively small changes is impor- 
tant. It has been suggested (Reference 4, p. 128) that supplementary 
run tests may prove useful in such applications. Various run tests are 
used in practice to supplement the standard control chart test,* but 
little has been published on the properties of the resultant tests, f though 
it is quite apparent that each additional supplementary run test em- 
ployed decreases the number of Type 2 errors made and increases the 
number of Type 1 errors. 

There are several alternative ways to reduce the number of Type 2 
errors made; we can: 

(1) Set the limit lines closer to the nominal process average X '. 

(2) Increase the sample size. ' 

(3) Replace the standard test with a single test for runs of points 
outside of appropriate limits. 6 

(4) Supplement the standard test with one or more run tests. 

(5) Temporarily modify the sampling procedure — e.g., increase the 
sample size or frequency of sampling — whenever a point falls outside 
of "warning" limits but inside of the "action" limits (3a limits). 4, 7 

* See footnote, page 89. 

t After the page proofs of this paper had been received, the author was advised 
of Reference 9, which deals primarily with the test T\>(Li , Lo). 
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(0) Use a control chart for a statistic other than X„ ; for example, plot 
points representing the moving average of k consecutive a„'s. 
The improvements generally require extra information or more com- 
plicated tests, or they result in an increased frequency of Type 1 errors. 

In this paper we study the properties of various run tests that either 
replace or supplement the standard control chart test in application (a). 
We limit our study to a particular type of run tests which we call "zone 
tests" because they test for runs of points in various zones into which 
the control chart is partitioned. For example, we study such tests as 
Tir (3, 2),f which calls for action if a single point falls outside of the 3<r 
limits or if two of three consecutive points fall outside of a 2a limit line. 
We limit our studies to tests used on charts of the statistic X„ ; zone 
tests can be useful on other charts, but their properties depend on the 
properties of the particular statistic plotted. Our results apply for any 
sample size and frequency of sampling. 

We use T k (L k ) to denote a test for k consecutive points outside of one 
of the pair of limit lines at AY ± L k (a/\/n), and T k >(L k ) to denote the 
test for k out of k + 1 consecutive points outside of the limit lines. If 
we combine two tests, we let T klk - 2 (L kl , L/ 2 ) denote the combined test 
that calls for action on the occurrence of cither type of run; fri and k 2 are 
integers less than nine, either primed or unprimed. 

For simplicity of notation we may eliminate the brackets on the test 
notation if the subscripts provide sufficient information. For this purpose, 
we adopt standard limits for certain runs. Thus we may use T 1 rather 
than Ti(3) to denote the standard control chart test. Also, we use the 2a 
limits, the 1 a limits, and AY itself as standard for runs of lengths 2, 4, and 
8, respectively. Thus T n - means 7u'(3, 2), and 'l\ means 7' 8 (0). We use 
an asterisk to denote one-sided tests — those with limit lines on only one 
side of AY. Test 1\* has a single limit line, at AY -f- 3(<r'/V»)« 

1.2 Process Model 

We use a process model in which the process average is X' = AY + A, 
where A is subject to change. A picture showing how A changes with time 
would show a series of rectangular pulses (positive or negative) of vari- 
ous heights, separated by periods with A = 0. The beginning of a pulse 
corresponds to the occurrence of an assignable cause of variation, and 
the height of the pulse is a function of the particular cause. The pulse 
ending corresponds to the elimination of the trouble. The distribution of 



t Read subscript as 1,2'. 
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the lengths of the pulses depends on the test we use to detect changes; 
the test should be designed to keep the lengths reasonably short. 

The sample average, X„ , is assumed to have a normal distribution 
defined by its expected value X' and standard deviation a'/y/n. 

Whenever A = 0, the process average is at its nominal level, and we 
say the process is in State 1 . Whenever A j£ 0, there is trouble present, 
and we say the process is in State 2. We assume that no additional 
changes occur while the process remains in State 2. 

At each point we look for certain rune that rarely occur in State 1. 
In the absence of such runs there is no indication that the process is not 
in State 1, and accordingly we do not look for trouble. We do not at- 
tempt to define the probability that the process is in State 1 at any 
point. In this model, we stop the process to look for trouble on the first 
occurrence of a run for which we are testing. When the process starts 
again it is assumed to be in State 1 ; consequently, the testing procedure 
ignores previous points. 

Relatively straight-forward mathematics can be used to describe the 
properties of certain tests acting within the framework of this process 
model. Alternative, and perhaps more realistic, assumptions can easily 
lead to much more complicated problems of description. In many cases 
the results obtained here can be used to describe qualitatively the prop- 
erties of tests applied to more complex processes. 

1.3 Measuring the Two Types of Decision Errors 

As each point is plotted on the control chart we decide either that the 
process is in State 1 — in which case we leave it alone — or that it is 
in State 2 — in which case we look for trouble. We make a Type 1 error 
when we say that the process is in State 2 when actually it is in State 1 ; 
Type 1 errors initiate needless action. We make a Type 2 error when we 
say that the process is in State 1 when actually it is in State 2; Type 2 
errors fail to initiate needed action. We generally make a series of con- 
secutive errors of Type 2 before detecting the change in state. 

Let the random variable y denote the number of points plotted while 
the process remains in State 2. Then y — 1 consecutive errors of Type 2 
are made. Let E{y) denote the expected, or average, value of y\ then 
E{y — 1 ) is the average length of a series of Type 2 errors. 

E(y) depends on A, the amount by which the process average changes; 
we sometimes note this dependence by writing E(y\ A). E(y\ A) is a 
monotonically decreasing function of the magnitude of A; that is, the 
larger the change, the smaller is E(y). In other words, tests are more 
sensitive to large changes than to small changes. 
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Fig. 1 — E{u) versus A for 7\(Li) for various limits. 

Fig. 1 shows curves of E(y) versus A for 7',(Li) for L\ = 2, 2.5, 3, and 
3.5. Note on the curve for 7\(3), for example, that E(y) = 15 at A = 
1.5 (tr'/Vn); this means that following a change of this magnitude, an 
average of 15 points are plotted before a point falls outside of a 3<r 
limit. Note that as A approaches zero, E{y) approaches 370, which cor- 
responds to the average number of points between consecutive Type 1 
errors while the process remains in State 1. 

In Fig. 1 and later figures the abscissa is A, and it is measured in units 
of cr'/y/n, which is the standard deviation of X» . The particular ab- 
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scissa that applies to a change of a given physical magnitude is propor- 
tional to y/n; for example, if n is doubled in the above example where 
A = l.o(a'/\/n), then the appropriate abscissa on Fig. 1 increases from 
1.5 units, with ordinate E(y) = 15 on curve T Xi to 1.5V2 = 2.121 
units, with E(y) = 5.4. The positions of the curves relative to one an- 
other are independent of n. 

If the process were to remain in State 1 indefinitely, E(y; 0) would 
represent the average number of points between consecutive Type 1 
errors, and l/[E(y; 0)] would be the asymptotic probability of a Type 1 
error. In comparing tests with respect to Type 1 errors, we compare 
their values of E(y; 0). 

In comparing tests with respect to Type 2 errors, we compare their 
values of E(y), or E(y — 1), for various non-zero values of A. 

1.4 Comparing the Statistical Properties of Various Zone Tests 

We are primarily interested in the distribution of y. The distribution 
of y for all of the zone tests we consider can be adequately summarized 
by one parameter — its average value E(y) (see Section 3.1). Therefore, 
in comparing the statistical properties of various tests, we compare their 
curves of E(y) versus A. From such curves we can determine the asymp- 
totic probability of Tj^pe 1 errors, l/[E(y; 0)J, and the average number 
of consecutive Type 2 errors, E(y — 1 ; A), for any A different from zero. 

Figure 1 illustrates how the properties of zone tests can be changed by 
changing the limit lines. By changing the limit lines of T x (Li) from L\ = 3 
to L x = 2, we reduce E(y) for all values of A: when A > 0, this means 
that the Type 2 errors are reduced; when A — 0, this means that 
Type 1 errors are increased. 

A choice between two tests should be based partially on the relative 
values of the two types of decision errors. We can fix the Type 1 errors 
at any desired level by an appropriate setting of the zone limits; then 
the Type 2 errors alone serve as a basis of comparison. 

II. SUMMARY OF RESULTS 

Section 4 shows how to determine the distribution of y, and in partic- 
ular its average value E(y), for one-sided tests T k *(L k ) and JV*(L*), 
for any k. Simple substitutions into equations for the above one-sided 
tests allow us to determine the properties of any test of type T ik *{L\ , Lt) 
or Tik*(Li , Lk). We then determine the properties of two-sided tests 
from the properties of the corresponding one-sided tests. 

We show that the average values of y in any two separate tests provide 
upper and lower bounds to the average value of y in their combined test. 
Thus with subscript ^i denoting test T tl , fa denoting T t „ , and Ufa de- 
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noting the test T tl ,„ combining 7\, and T h , we have upper bounds 

E tl t s (y, A) ^ E tl (ir, A), E llh (y; A) ^ E t ,{y; A), (lj 

and a lower bound 

1 l + i , (2) 



/?,,,,(//; A) ««,(kA) #,,(y; A) 

An application of (2) to the determination of the properties of two-sided 
tests in terms of the properties of their component one-sided tests yields 

_J _~ _J___ + __J (3) 

E(y;A)-E*(y,^ E*(y;-AY 

where the asterisks denote one-sided test results. 

We can determine the properties of the following tests: T k (L k ), 
T k >(L k ), Tniln , L k ) and 7V(L, , U), for any fc. With U = 3, the last 
two types of tests supplement the standard control chart test 7\(3) 
with one other zone test. 

Equations (1) support the logical conclusion that the more criteria 
we have to indicate the presence of trouble, the more quickly we will 
look for trouble when it is present as well as when it is not present. Thus, 
in supplementing the standard control chart test with other tests, we 
decrease the Type 2 errors at the expense of more frequent Type 1 er- 
rors. The question of how far to go in supplementing the standard control 
chart test must be answered in light of the relative importance of the two 
types of errors in the particular application considered. 

Section III presents a series of charts to show the properties of several 
particular tests, including 7', , T n , T 1V , 7' 18 , and IWa . The last test* 
illustrates the effect of supplementing 7', with more than one additional 
test; its properties were determined through the use of Monte Carlo 
techniques. We also show E(y) versus A for several tests when their zone 
limits are translated away from the center line so that their Type 1 
errors are comparable to those of 7', . It is through such translations of 
zone limits that we can offset the undesirable effect on Type 1 errors 
that occurs when we add new tests to our testing procedure. 

III. CHARTS SHOWING PROPERTIES OF VARIOUS ZONE TESTS 

3.1 Distribution Function of y 

The cumulative distribution function of the random variable y, 
Qj = Prob (y > ./), is shown in Figs. 2 and 3 for various zone tests. 

* This test is similar to one that has been used by the Western Electric Company 
in its quality control training program; somewhat different criteria for taking 
action are used and therefore the statistical properties differ. 
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The curves are applicable only at integral values of j. If y > j, there 
have been no indications of a changed process average in the first j 
points following the change from X ' to AY + A. 

Fig. 2 shows curves for 7\ , T v , TV , and 1\ for A = 0, a'/y/n, and 
2(a'/Vn). Fig. 3 compares T, , T v , T w , and T ivei for A = a'/Vn; 
it illustrates the effect of additional tests on the distribution of y. 




Fig. 2 — Cumulative distribution of y for T, , 7V , 77 , and 7' 8 forA = 0, a'/y/n, 
imd2(<r'/Vn). 
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Fig. 3 — Cumulative distribution of //for T\, T«', Tu' and Tint's for A = a'/y/n. 

The curves of Figs. 2 and 3, plotted on semilogarithmic paper, can 
be approximated for practical purposes by straight lines. Thus, the dis- 
tributions are approximately geometric, or discrete exponential, dis- 
tributions that can be described by a single parameter E(y) and an 
initial value. It is for this reason that E{y) adequately summarizes their 
statistical properties. 



02 



THE BELL SYSTEM TECHNICAL JOURNAL, JANUARY 1958 



Figs. 2 and 3 illustrate the fact that single tests for long runs, such as 
T% , do not become fully effective immediately following a change. 

3.2 Curves of E(y) Versus A for Tests with Standard Zone Limits 

Figs. 4, 5, and G illustrate typical curves of E(y) versus A. Fig. 4 
shows curves for r l\ , 7V , 7Y , and 7' 8 . Fig. 5 shows the effect of broad- 
ening the criteria for looking for trouble — T-> calls for action only if 
two consecutive points fall outside of a 2a limit, whereas 7V calls for 
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Fig. 4 — E(y) versus A for '1\ , 7V , TV , and T 8 . 
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Fig. 5 — EUj) versus A for T x , T 2 , ZV , T i2 , and TV . 

action whenever 7' 2 does and also whenever two points falling outside a 
2a limit are separated by a single point not falling outside of the 2<r limit. 
E{y) is less for T v than for T-> for all values of A; this difference is re- 
flected in the curves for 7Y_> and 7',- , which supplement T } with To and 
7V , respectively. 
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Fig. 6 — E(y) versus A for 7'i , T$ , 7'is , and 7'i 2 Y8 . 

Fig. G illustrates the effect of supplementing 1\ first with r l\ and then 
with Ts , Ty , and TV . Notice how the Type 1 errors become more 
frequent as Type 2 errors decrease. 

3.3 Curves of E(y) Versus A with Limits Set for a Selected Probability 
of Type 1 Errors 

Fig. 7 shows curves of E(y) versus A for tests for k (k =1,2, 3, 4, (>, 8) 
consecutive points outside of limits that are set for each A: so that the 
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probability of a Type 1 error is comparable to that of T x . Tests for long 
runs clearly are most effective against small process changes, while Ti 
itself is most effective against large process changes. 

Fig. 8 shows curves for T, , T 8 (0.065), and T 18 (3.19, 0.19). The last 
test is composed of the first two tests with all zone limits translated away 
from AY. Notice that T, and T 8 (0.0o5) taken individually are more 
effective than T 18 (3.19, 0.19) in certain ranges of A. Fig. 9 illustrates 
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Pi g< 7 _ E(u) versus A for Ti(L k ) for A- = 1,2, 3, 4, 6, and 8 with limits set for 
the same probabilities of Type 1 errors. 
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Fig. 8 — E(u) versus A for T x , T S (L 8 ), and T ls (Li , L 8 ) with limits set for the 
same probabilities of Type 1 errors. 
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Pie. 9— E(y) versus A for T, , 7V(L,'), Tw{Li , L,'), and 7', 2 ' 4 ' 8 (L, , L s ' , L 4 ' , L 8 ) 
with limits set for the same probabilities of Type 1 errors. 
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the same general ideas as Fig 1 8, with the addition of TWs with its zone 
limits translated away from X '. 

Because logarithmic scales are used for E(y), the differences 
Ei(y) - E t (y) between curves for 7\ and other tests are distorted; 
Fig. 10 shows the difference on an arithmetic scale for two of the curves 
of Fig. 9. 

Fig. 11 supports the theory that T k -{L k .) is slightly more sensitive 
to small changes than T k (L k ) when the limits are set so that the two 
tests have the same probabilities of Type 1 errors. Further graphical 
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Fig. 10 — The difference between ordinates of curves of Fig. 9 shown on an 
arithmetic scale. 
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Fig. 11 — E(y) versus A for 1\(L\) and Tt'(Li') with limits set for the same 
probabilities of Type 1 errors. 

support is given by curves for 7V(1.93) of Fig. 9 and T»(1.78) of Fig. 7. 
No analytical proof has been developed. 

IV. DETERMINING THE STATISTICAL PROPERTIES OF ZONE TESTS 

4.1 General Procedure 

With the control chart partitioned into mutually exclusive zones A, 
B, C, D, ■ ■ ■ , R, we represent a sequence of points falling consecutively 
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into zones B, C, D, and B, for example, by the sequence bcdb. The lower 
case letters such as b serve a dual purpose — they denote the fact that a 
point falls into a particular zone, and they denote the probability of that 
particular event, or outcome. For example, the probability of a particular 
sequence bcdbcdb is b 3 c 2 d~. Where there is danger of confusion, we may 
denote outcome b by u and its probability by p b ■ A sequence bcdb is 
considered to represent the outcome of a sequence of independent trials, 
each of which has fixed probabilities of outcomes a,b,c, • • • , r. 

Since the control chart points represent an average measurement X n 
that has a normal distribution with average AY + A and standard de- 
viation a'/y/n, we use normal probability tables to determine the proba- 
bility b, which remains constant from point to point as long as the proc- 
ess remains in a given state. If $(x) is the area under the normal_ curve 
above x, and if zone B is between limit lines at X ' + L<X<r'/\/n) and 
AY -f- Liia'/x/n), where L 2 ^ L x , then probability 

h ~ <1> ( L, ~ - v " )-<M Li " ^ 



When the process changes from State 1 to State 2, the probabilities 
of points falling into the various zones change. At the first point in State 
2, zone tests see one point from State 2 preceded by a sequence of points 
from State 1; at each subsequent point in State 2 a single point from 
State 1 is dropped from consideration, until at last all points considered 
are from State 2. The zone tests are such that the probability of a point 
from State 2 falling into a critical zone is greater than the probability of 
a point from State 1 falling into the same zone. Consequently, the proba- 
bility of the occurrence of a run of points in a critical zone is greatest if 
all of the points are from State 2. For simplicity and clarity we neglect 
points from State 1 while considering the results of testing points 
from State 2. This means that T s , for example, does not become effec- 
tive until the eighth point in State 2 appears. This simplifying assump- 
tion will affect the results little; its effect can be eliminated by calculat- 
ing the probability of detecting the change in the first few points and 
adjusting our results. As an illustration, T 8 (0.0fi5) of Fig. 7 should ap- 
proach 7.1, rather than 8, as A approaches infinity. 

If a control chart is partitioned into three mutually exclusive zones 
.1 , B, and C, outcomes a, b, and c are associated with the events that 
points fall in the respective zones, and probabilities a, b, and c 
(a + b + c = 1) are the corresponding probabilities of the events, or 
outcomes. The possible outcome of the first j trials, or points, can be 
enumerated by the ordered expansion of the multinomial (a -+- b + c) J . 
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For example, with j = 2, we have: 

(« + b + c)~ = aa + ah + ac + ba -\- bb -\- be + ca + c6 + cc. 

The probabilities of the various sequences occurring are obtained simply 
by multiplying the individual terms; for example, sequence aa has prob- 
ability a 2 . The probability of a particular event such as the event that 
either a or b occurs at least once in the first two trials is determined by 
selecting those sequences in which this event occurs and cumulating 
their probabilities; in this case it is a 2 + 6" + 2ab + 2ac -f- 2bc. 

If we wished to determine the probability Qj of no occurrences in the 
first j trials of an event e (a run of eight consecutive points in zone A, 
for example), we could enumerate all of the 3 possible outcomes, pick 
out those we were interested in, and determine their probabilities. This 
procedure becomes very tedious as j increases, and we soon look for 
shortcuts. We attempt to find a recursion equation defining Qj in terms 
of a limited number of terms Qj_ x , Qj_.> , etc. If we can find such an 
equation, we need to enumerate all pertinent outcomes only to the point 
where the equation becomes effective. 

A recursion equation for Qj , together with a set of initial conditions, 
leads to a generating function Q(s) whose power series expansion ex- 
hibits Qj as the coefficient of s 3 : 

Q(s) = 1 + Qi8 + Q 2 8 2 + • • • + QjS 1 + • • - £?_« Qjt? . (4) 

The generating function is useful in obtaining moments of the distribu- 
tion of y. In particular, we obtain E{y) by setting s = 1 in the equation 
for Q(s):E(y) = Q(l). 

The simplest zone tests are those in which a point is classified in one 
of two categories; it represents either event t p with probability p or 
event e q with probability q = 1 — p. We arbitrarily call e p a success 
and e q a failure.* We call a test for success runs a simple run test. A 
compound run test is composed of more than one simple run test; for 
example, a test for a run of two consecutive points above the +2o- limit 
is a simple run test, but a test for a run of two consecutive points above 
the +2<r limit or below the — 'la limit is a compound run test composed 
of two simple run tests. A simple run test classifies points in two ways; 
a compound run test classifies points in more than two ways. 

The test for a run of two consecutive points above the +2tr limit is a 
one-sided zone test; the test for a run of two consecutive points above 



* This terminology may seem incongruous, since we hope for events *,, , which 
we term failures. Alternatively, we could change the definition, and say that we 
test for failure runs, hut this conflicts with standard terminology. 
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the +2<r limit or below the — 2<r limit is a two-sided zone test. We derive 
the properties of two-sided tests from those of one-sided tests. 

In Sections 4.2 and 4.3 we present recursion equations and generating 
functions for Q 3 , the probability that y > j, for the following simple 
run tests: 

(1) k consecutive successes k = 1, 2, 3, 4, • • • , 

(2) k successes in k 4- 1 (or k) consecutive trials k = 2, 3, and 4. 
In addition, we describe a procedure for extending k in (2) to any value. 
Equations for E(y) are also presented. The results apply to one-sided 
zone tests. 

Section 4.4 describes a procedure for determining the properties of 
two-sided zone tests from the properties of one-sided zone tests. 

Section 4.5 presents a procedure for determining the properties of any 
run test combined with a test for a single point in a critical zone. Simple 
substitutions into the equations for a particular one-sided zone test lead 
to a description of the properties of that test in combination with the 
standard control chart test Ti*. 

Section 4.6 develops upper and lower bounds to E(y). Section 4.7 
shows how to determine easily the properties of some tests whose zone 
limits are non-standard. Section 4.8 discusses the use of Monte Carlo 
techniques for determining the properties of tests more complex than 
those considered here. 

4.2 The First Occurrence of k Consecutive Successes 

We separate those sequences of outcomes having no occurrences of k 
consecutive successes in the first j trials (that is, y > j) into mutually 
exclusive categories according to whether the last failure occurred on 
trial j, j - l,i - 2, • • • or j — fc 4- 1. With Qj denoting the probability 
that y > j, we let Qj. ,- denote the probability that y > j and that trial 
j — i resulted in a failure and the succeeding i trials resulted in successes. 
Then, since i can be no greater than k — 1, we have the equation: 

Qi = Qifi + Qj.i + Qi,2 + • ■ • + Qi.k-i ■ ( 5 ) 

We enumerate the possible results: 

Sequence ,.,... r „ 

Endings Probabilities of Occurrence 

q Qj.o = q(Qj-i,o + Qi-i.i + ■■• + Qi-i.h-i) 

qp Qj.i = pqiQs-t.o + 0>-2.i + • • • + Qi-2.k-i) 

qpp Qj.i = p 2 q(Qi-3,o + Qi-J,i + ■•■ + Qi-i.Jfc-i) 

qppp Qj,3 = p 3 q(Qi-*.a + Qi-i.i + ••■ + Qj-4.k-i) 



qpp ■■■ p Qi,k-i = p k ~ l q(Qi-k,o + Qi-k.i + •■ + Qj-k.k-i) 

k - 1 p's 



PROPERTIES OF CONTROL CHART ZONE TESTS 103 

The equations on the right reduce to Q,,, = p*gQy_f_i . We obtain the 
desired recursion equation by summing over all values of i, 

Qj = gQ y _, + pqQj-i + p 2 qQ^ 3 + • • • + p~ l qQj- k . (6) 

We can use (6) to calculate Qj for ,7 ^ k, noting that Qj = 1 for 7 < k. 

We obtain the generating function of Qj from (6), 

G« = i 1 ~/*l si • W 

1 — s -|- qp K s k+1 
Then !£(//) is obtained by setting s = 1 in (7), 



£(*/) = ] —j^ ■ (8) 

These results are well known. 8 

4.3 The First Occurrence of k Successes in k + 1 Consecutive Trials 

As in the preceding section, we separate those sequences having no 
occurrence of the event in question — in this case k successes in k + 1 
consecutive trials — into mutually exclusive categories according to 
whether the last failure occurred on trial j, j — 1, j — 2, • • • , or j — k -f- 1. 
In the current problem, however, we are also interested in the location 
of the next-to-the-last failure since if the event in question has not oc- 
curred there must be at least two failures in the preceding k + 1 trials. 
If the last failure was on trial j — (k — 2), for example, there must be 
at least one other failure in the preceding two trials. Here an enumera- 
tion of possible results yields: 

Sequence 

Endings Probabilities of Occurrence 

q Qi.o = q(Qj-i.o + Qt-i.i + • • • + Q,-..*- 2 + Qi-,,k-i) (9.0) 

qpQi.i = Pq(Qj-2.o + Qi-2.1 + • • • + Q/-2.*-2) (9.1) 

qppQi.i = p 2 q(Qi- 3 .o + ■ ■ • + Qj-i.u-t) (9.2) 



qp ■ ■ ■ ppp Qi.t.t = p*-*?(Q,-(4-i). + QMfe-0.1) (9.(k - 2)) 

qpp ••• pppQj.k-x = p'- 1 ?(Q,_*,o). (9.(k - 1)) 

k - 1 p's 

Each equation in (9) has one term less than the equation immediately 
above it. We adopt a standard procedure for deriving a recursion equa- 
tion for Qj from equations (9). First we find from (9.0) that: 

Qifi = qQj-i ■ (10) 

Then we substitute (10), with,/ reduced by k, into (9. (A- — 1)): 

Q M _, = p'-WQj-i-i ■ (ii) 



104 THE BELL SYSTEM TECHNICAL JOURNAL, JANUARY 1958 

Next we translate the final term on the right-hand side of (9.0) to the 
left-hand side, and substitute (10) and (11), the latter with/ reduced 
by one. Then, if we multiply through the new (9.0) by p and reduce j 
by one, its right-hand side is identical to that of (9.1). Then we have 

Qia = mQj-i ~ vqQj-l-? ■ (12) 

We substitute (10) and (12), withj reduced by (k - 1), into (9.(& - 2)) 
to obtain 

We proceed step by step, taking equations from the top and then from 
the bottom, to find equations for the Qy.i's in terms of Q/s. Then we 
add all of the equations together to obtain the recursion equation for 
Qj , which will depend on some of the k(k + l)/2 immediately preceding 
Q/s. The recursion equation is used with k(k + l)/2 initial Q/s to de- 
rive the generating function Q{s). 

4.31 The First Occurrence of Two Successes in Three Consecutive Trials 
As in (9), we have: 

Sequence Endings Probabilities of Occurrence 

■a Qj.a = <l(Qj-i. + Ql-i.i) (14-0) 

qp Qi.i = pqiQi-t.o)- (14-1) 

Then Q jfi = qQj-i , Qj.i = pqQj-s , and the recursion equation is 

Qj = qQj-i + vqQj-z> J> 2 - ( 15 ) 

With (15) and the initial conditions Q = Qi = 1 and Qs = 1 - p\ 
we derive the generating function for Qj : 

Q (S ) = i+w + mf (16) 

1 — qs — pqs 3 
E{\j) is obtained by setting s = 1 in (16); 

^ = l Ovf- (17) 

4.32 The First Occurrence of Three Successes in Four Consecutive Trials 
The initial conditions are: 

Q a = Qi = Qi = 1, 

Qs = 1 - v\ 

Q, = 1 - p 3 - 3p'g, 

Q 5 = 1 - p 3 - 3p'ff - 3p¥- 
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For j > 5 we follow the standard procedure to find a recursion equal ion 
for Qj in terms of the 3-4/2 = 6 preceding 0/s: 

Qj - qQj-i + PffQy-a + pV0i-* ~ pVQi-* , J > 5. (18) 

The generating function is 



11 i 2 2 i 2 .'! 3 4 3 2 5 

Q( s ) = 1 + ps + P s + P 9 s - PQ* - pqs 
1 — qs — pcjs- — p-q-s* + ttV/V 



(1!)) 



and the expected value of y is 



m = L+p+Z+|g , (20 ) 

p'O + q + g 8 ) 

4.33 TVifi Ftrs/ Occurrence of Four Successes in Five Consecutive Trials 
Here the 4 • 5/2 = tO initial 0/s are: 

0o - Qj = & - 03 =1, Q< = 1 - p\ 

(h = Q\ — 4pV 

06 = ^5 — 4pV> 

07 = 06 - 4pV - 3pV, 

0a = 07 - 4pY - 7pV - 2p¥, 

09 = 8 - 4 P V - iipV - 8pV - pV- 

For,/ > 9 the following recursion equation holds: 

Qj = qQj-i + P30/-2 + p'q 2 Qj-i + 2p 9 q 2 Qj-s 

(21) 
-pqQi-i - p qQj-w- 

The generating function of Qj is 

1 + ps + 7> 2 .s J + pV + 2p 3 qs* — p A qs b 

4 2„6 6 2 8 6 3 9 

Q(s) = ~ pqs -M* ~Pg« . (22) 

1 — qs — pqs- — p 2 q 2 s A — 2p z q 2 s* 

i 4 a 7 | 6 4 10 

+ p q s + p q s 



Then 



il I r» 2 I n 3 4 4 2 6 2 6 3 

#(,,) = A + p + 2 p + 2 pq - pq - pq - vq - v g 

p 3 (l + 4 - 2(/-' + pr/ + pV) 



(23) 



4.4 Properties of Two-Sided Zone Tests 

The results presented in Sections 4.2 and 4.3 are applicable to the 
study of the statistical properties of one-sided zone tests for runs of 
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points in the zone above an upper limit line at Xo + LkW/y/n). Gen- 
erally, we also test for the same types of runs below a lower limit line 
at Xo - L k (cr'/\/n), in which case the test is a two-sided zone test and 
each point falls into one of three mutually exclusive zones. 

Let A denote the zone above the upper limit, B denote the zone be- 
tween the two limits, and C denote the zone below the lower limit. Con- 
sider an infinite sequence of independent trials having possible outcomes 
a, b, and c with fixed probabilities a, b, and c. When the outcome of the 
jth trial completes a pattern of outcomes describing an event e we say 
that e occurs on the jth trial. Event e is defined by a set of outcome pat- 
terns and a counting, or testing, rule. If when e occurs on the jth trial 
we treat trial j + 1 as though it were the first trial, ignoring the results 
of the first j trials, then e is a recurrent event. 8 

Let 
Uj = Probability that e occurs on the jth trial, 
fj = " " " " for the first time on the jth trial, 

Qj = Probability that « does not occur in the first j trials. 

Denote the generating functions of w, , // , and Qj by U(s), F(s), and 
Q(s), respectively. 

The following equation can be used to determine the Q's in terms of 
the/'s: 

Q(s) = 1 ~ F(S) - 1< 8 < 1. (24) 

I s 

If e is a recurrent event the following equation holds [Reference 8, 
p. 243]: 

Ui = fi + fj-m + //-2U2 + • • • + fiVj-i . (25) 

Equation (25) leads to the following identity (setting f„ = 0, u = 1) : 

"« - T^m- (26) 

From (24) and (26) we have 

(1 - a) U(s) - jLj, - 1 < 8 < 1, (27) 

for recurrent event «. We shall consider only recurrent events which have 
finite recurrence times; in these cases F(l) = /j + /j + ■ • • = 1, and 
[7(1) is infinite. The limit of (1 - s)U(s) as s approaches unity from 
below is (using L'Hospital's Rule): 

lirn (1 - s) Uis) = W® = W) = W)' m 
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where y denotes the number of the trial of the first occurrence of c, and 
E(y) denotes its expected value. E(y) is also the average recurrence time 
(average number of trials between consecutive occurrences) of recurrent 
event e. 

Consider recurrent events «i , e 2 , and t ]2 , defined, respectively, by the 
sets of outcome patterns a, /3, and a or /3 and a counting rule that re- 
quires counting to start from scratch on trial j(j > 1) if and only if the 
event under consideration occurs on trial j — 1. Assume that ei and e 2 
are mutually exclusive — that is, they cannot both occur on the same 
trial. 

For an example, let the single pattern a c a define the set a and the 
pattern c a c define the set fi — then the set a or /3 has the two patterns 
a c a and c a c. Consider an outcome sequence: 
trial number: 12 3 45G789 

trial outcome: acacacaba 

The event ei occurs on trials 3 and 7 ; the event e 2 occurs on trial 4 ; and 
the event en occurs on trials 3, 6, and 9. 

Let Ei(y), E-,(y), and E u (y) denote the average recurrence times of 
ei , £ 2 , and €12 , respectively. Under what conditions can we determine 
En{y) from known values of Ei(y) and E 2 {y)7 

Consider events t\" and e 2 " defined by outcome patterns a and /3, re- 
spectively, and a counting rule that requires counting to start from 
scratch on trial j if and only if either t\ or e 2 " occurs on trial j — I. 
Events ei" and c 2 " differ from d and c 2 only in counting rules. In the 
example previously considered, we see that ei" occurred on trials 3 and 
9, and e 2 " occurred on trial (i. Either f\" or e 2 " (but not both) occurs on 
every trial on which ei 2 occurs; this leads to the equation 

M 12li = wi./ + Hi./, (29) 

where i<v>,j , ii\,/' , and n 2 ./' denote, respectively, the probabilities that 
em , ei", and e 2 " occur on trial j. 

Multiplying (29) through by .s ; and summing over j from one to in- 
finity, we obtain an equation relating the generating functions of the 
probabilities in (29) : 

UM - Ui"(s) + U 2 "(s) - 1. (30) 

The constant appears because >/,, = 1 in all cases. 

Events a" and e>" are recurrent events, and equations (25) through 
(28) can be used to determine their mean recurrence times Ei"(y) and 
E 2 "(y). (The fact that (25) applies allows us to call e/' and e 2 " recur- 
rent events). 
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If we multiply through (30) by (1 - s) and take the limit of each side 
as s approaches unity (see (28)), we obtain 

1 ' + * (31) 



Eu(y) Ei'(y) E 2 "(y)' 

In any sequence of trial outcomes, if a pattern in a occurs for the first 
time on trial j, then ei occurs for the first time on trial j, and «i" occurs 
for the first time either on trial j or on a later trial; t\" will occur for the 
first time on a later trial if e 2 " occurred while this first pattern in a was 
being formed. Thus we have 

E^y) ^ E x »{y) (32) 

where the equality sign holds if and only if no pattern in /3 overlaps a 
pattern in a. A pattern in {J overlaps a pattern in a if the terminating 
outcomes of the former correspond to the beginning outcomes of the 
latter. Thus outcome pattern cac overlaps aca because the terminating 
outcomes a c of the former correspond to the beginning outcomes a c of 
the latter. If no pattern in /3 overlaps a pattern in a then the occurrence 
e 2 " does not "cancel out" the beginning of any patterns in a, and there- 
fore ei and e/' always occur on the same trials. 
From (31) and (32) we have 

1 g 1 + 1 , (33) 



En(y) ~ Ei(y) EM' 

where the equality sign holds if and only if d and e 2 are defined by non- 
overlapping patterns, in which case we shall say that ei and e 2 are non- 
overlapping events. From our example it is clear that mutually exclusive 
events are not necessarily non-overlapping. 

We can use (33) to find E(y) for two-sided tests in terms of the E*(y)'a 
of the component one-sided tests. Note that a given change A looks like 
a —A to one of the component tests. Then 

_J__ < l . + ! . (34) 

E(y;A) ~ E*(y; A) T E*(y; -A) 

For A = 0, E(y; 0) ^ (E*(y; 0)/2). The equality sign holds in (34) for 
T k (Lk) and 7V(Li , U). For T k -{U) and 7V(Li , U), (34) defines lower 
bounds which are very close approximations to E(y). For 7V equation 
(34) leads to a lower bound of 510.0, which compares with the true 
value E(y; 0) = 510.7. The degree to which the approximation ap- 
proaches the true value depends on the probability of overlap, which in 
cases we consider is very small; for this reason we can consider (34) to 
be an approximation rather than a lower bound. 
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4.5 Properties of Tests Combining jTi(Li) with One Other Test Whose 
Properties A re Known 

Consider any test T for which we partition the control chart into mu- 
tually exclusive zones A, B, C, ■ • -, R. The possible outcomes of the first 
j trials can be enumerated by an ordered expansion of 

(a + b + c + • • • + r y. 

With the letters denoting the probabilities of points falling into the 
various zones (a + b + c + ■ ■ ■ + r = 1), we pick out all of those 
terms corresponding to outcomes in which the event e does not occur, 
and denote their sum by 

Qi.j = Qj(a, b,c, ■ ■■ r). (35) 

Clearly Q t j , or gj , is the sum of a series of terms such as a'bc • • • , 
representing the probabilities of particular outcomes. 

If we wish to find the probability Quj of no occurrences of event e and 
no occurrence of a point falling in zones A or B, say, we simply eliminate 
from gj those terms in which either a or b occurs. We can do this by sub- 
stituting zeros for a and b wherever they occur in g } - : Q u ,j = gAO, 0, c, 
d, • • • , r). By multiplying and dividing each remaining term in gj(0, 0, c, 
d, ■ ■ ■ , r) by (1 — a — b)\ we derive an alternative expression: 



Qu,j = gj [0,0, 



1 - a - b' 1 - a - I)' 

r 



'1 - a - b 



(36) 
(1 - a - b) j , 



showing that the conditional probability of no « given no points in .4 
or B uses the same function required for Q ( j . This enables us to write 
the generating function of Qnj as 



Quto =h(o,0,- =-,- 

\ 1 — a — b 1 



d 



- a - b' 



' 1 - a - b 



(37) 
; (1 - a - b)i ^ 



where h(a, b, c, • • • , r; s), defined for a + b + c + • • • -f- r = 1, is the 
generating function of Q t ,j . 

The principles are best illustrated by an example. Consider the prob- 
lem of finding E\*{ij), the expected number of the trial of the first occur- 
rence oik consecutive points above X n ' + Li,-(<t' / s/ n) or a single point 
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above Xa + LiW/^/n), where L k < L x . We use an asterisk to denote 
the fact that a function applies to a one-sided test. We let a be the 
probability of a point falling above both limits, b be the probability of 
falling between the two limits, and c be the probability of falling below 
both limits. Then we substitute a + b for p, and c for q in (7) to obtain 

Following (37), we find Qu*(s) by substituting for a, 6/(1 - a) for 
b, c/(l - a) for c, and (1 - a)fl = (b + c)« for s in (39), 

We set s = 1 in (40) to obtain 

E lk *(s) = -. * " b " hk ■ (41) 

1 — (b + c) + c(r 

The properties of any test combining Ti(L\) with one other test whose 
properties are known can be determined in a similar way. 

4.6 Limits of E{ij) in Compound Tests 

A development similar to that in Section 4.4 will show, for example, that 

1 <r 1 + 1 + 1 (42) 

E m (y) 'EM E,{y) EM 

where Em{y) pertains to recurrent event e ]2 3 , whose set of outcome pat- 
terns is composed of those of recurrent events «i , e 2 , and e 3 . 
It can also be shown that 

EnM ^ E n {y) ^ EM (43) 

for example. Clearly we cannot increase the recurrence time of an event 
by increasing the different outcome patterns which define the event. 

4.7 Translating Limits to Obtain a Selected Probability of Type 1 Error 

By supplementing Ti with other tests, we increase the probability of 
Type 1 errors. We can adjust the probability of Type 1 errors to any 
desired level by resetting the zone limits. With more than one set of limit 
lines, we have some freedom in setting the limits. A procedure that has 
the important attribute of simplicity translates all of the limit lines away 
from the central line X ' by the same amount. The properties of the re- 
sultant test can be derived directly from the properties of the original 
test. 

We first determine the properties of one-sided tests whose limits are 
translated; from these results we determine the properties of the cor- 
responding two-sided test. 
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If Q*(L kl , Lk 2 ; A; s) is the generating function of Qj for test T* 
with limits at X ' + Lk x W I y/n) an d -XV + Lk t (<r' / y/n) and with the 
process average X' = X ' + A, then (neglecting points from State 1): 



Q t *(L kl , L, 2 ; A; s) m Q t * \L kl + h, L, 2 + h; A - h ~^ ; s J 



(44) 



This equation says that the probabilities involved are identical if we 
translate the limits by a given amount or if we translate the process 
average in the opposite direction by the same amount. The truth of this 
stems from the fact that the probabilities depend on the position of the 
process average X' relative to the zone limits. 

If we wish to set the limits so that the probability of a Type 1 error 
is jm: say, for a two-sided test, we can proceed as follows: 

(1) draw the curve of E(y) versus A for the corresponding one-sided 
test (the abscissa is assumed to be in units of <r'/y/n), 

(2) translate this curve to the right (or left) until E(y; 0) = 1000, 

(3) measure the amount h of the translation, and translate the zone 
limits away from (or toward) X ' by an amount h(a'/y/n) (control 
chart units). 

The translated E(y) versus A curve represents the new one-sided test. 
The curve for the corresponding two-sided test can be derived using 
(34); it will have a value E(y; 0) = 500. 

4.8 Monte Carlo Techniques to Determine the Properties of Zone Tests 

We can determine approximately the properties of zone tests by using 
Monte Carlo techniques on modern high-speed computers. First we 
generate a random series of numbers with a known distribution. Then, 
using the appropriate correspondence between limits within the distri- 
bution and zone limits, we translate the random numbers into a random 
sequence of zone designations, which we test for occurrences of the events 
in question. We keep score of the number of points until the event finally 
occurs. We then start counting again as though the sequence were just 
starting. By running through a great many cycles, we obtain an approxi- 
mation to the distribution of the cycle length y, and an approximation 
to E(y) for the particular value of A that applies to the limits we used. 
We repeat the process with different limits for different values of A. 

Within the limitations of the computer, this technique can be used 
for any zone test. We used it to approximate the properties of Tw^s 
for A = 0, -r'/Vn, 2(a'/\/n), and 3(«r'/\/«)- 

V. CONCLUSIONS 

If we supplement the standard control chart test with another zone 
test, we increase its sensitivity to process changes at the cost of more 
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frequent errors of Type 1 and a more complicated testing procedure; 
see Figs. 5 and 6. We can restore the original probability of Type 1 
errors by changing the zone limits; in the following discussion we shall 
assume that this has been done, thereby simplifying the comparison of 
various tests. We shall say that a zone test T, of the type we are con- 
cerned with is better than 7\ for a particular value of A if E,(y) < E x {y) 
for that A. 

In general, the curve of E(y) versus A for a test T t is below the cor- 
responding curve for T x for A in a range < A < A, , and above for 
A > A, . The crossover point A, in the cases we considered varied from 
1.7 (ff'/Vn) for :T 8 (0.065) (Fig. 7) toover3.5 (a'/Vn) forT 12 .(3.1Z, 2.13) 
(Fig. 9). 

Consider a test T u that combines Ti and T t and has its zone limits set 
so that its probability of Type 1 errors is the same as for 7\ and foi 
T t . In the cases we have considered (see Figs. 8 and 9) T u essentially 
effects a compromise between 1\ and T, - for small changes it is better 
than 1\ but not as good as T, ; for large changes it is better than T t 
but not as good as T x ; for A near A, it is better than r I\ and better 
than 1\ . 

In the cases we have considered, tests T k '{L k >) appear to be slightly 
better than tests T k (L k ) for small changes. 

The reason that zone test T t is better than 1\ for small changes seems 
to be due to the fact that it bases its decisions on a history of k consecu- 
tive points; in effect, it makes some use of a sample size kn rather than 
n. The cost of the increased effective sample size is paid during the first 
k — 1 points in State 2, where r J\ has a higher probability than T t of 
detecting a change. The probability that a point falls outside of a 3a 
limit remains fixed from sample to sample, and after the initial k — 1 
points in State 2, this probability is less than the probability that T t 
will detect a run. Large changes are likely to be detected by Ti before 
T t becomes effective; but when changes are small the corresponding 
values of E(y) are large, and we can expect T t to detect the change be- 
fore Ti does (see Fig. 7). 

We have assumed that sample averages X„ are plotted on the control 
chart. In light of the above discussion the possibility of pooling data 
from k consecutive samples and plotting a statistic based on the kn 
measurements involved appears promising. 

A preliminary study of zone tests on charts of moving averages of k 
consecutive equal-sized samples has been made. The statistic (or point) 

Y kll j = (X„j + X„j-i + • • • + X„,j- k+ i)/k 

can easily be determined graphically in many cases. For example, the 
point Y 2 „j is halfway between points X„,,_i and X n j on the straight 
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line connecting them — vertical rulings on cross-section paper ordinarily 
used will spot points exactly. Points Y. hl ,, can be similarly derived from 
points Y-inj-" and Y-> n j . Fig. 12 .shows curves of E(y) versus A for T\ 
used on points Y k .»j(k = 1, 2, 4); limit lines were assumed to be at 
Xo ± 3(<r' / s/ kn) . The curve for fc = 1 is, of course, the curve Ti of 
earlier figures; the curve for k = 2 was derived using tables of the bi- 
variate normal distribution; the curve for k = 4 is an approximation 
based primarily on the results of a study making use of Monte Carlo 



500 
400 

300 

200 

150 



100 
90 
80 
70 h 
60 
50 

40 
30 

E(y) 

20 
15 






1.5 i 

A IN UNITS OF 



IT' 



Fig. 12 — E{y) versus A for T\ applied to moving averages of A-(A- = 1, 2, 4) 
consecutive sample averages. 
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techniques. We cover the possibility that the first point in State 2 will 
fall outside of its control limits by assuming the existence of prior points 
in State 1 ; all three curves approach E(y) = 1 as A approaches infinity. 

In comparing Fig. 12 with Figs. 7, 8, and 9, it appears that 2\ used 
on moving averages provides an effective test for detecting shifts in 
process averages. Further study is required to determine the effective- 
ness of other run tests and of combinations of run tests applied to various 
moving averages. 

In summary, it is possible to devise zone tests which — within the 
constraints of our model: 

(1) indicate changes in process averages when none has occurred with 
the same average frequency as the standard control chart test 7\ , 

(2) detect small changes in process average — up to 1 .3</, say, for 
n = 5 — sooner on the average than 1\ , and 

(3) detect larger changes inappreciably later on the average than 7\ . 
Such tests require an appropriate setting of zone limits — generally at 
non-integral multiples of a'/\/n. If run tests are used to supplement T\ 
without a compensating setting of zone limits, an increased frequency 
of false indications of process changes results. 

The standard control chart test T x (or Ti(Li)) is slightly more effec- 
tive than alternative zone tests in detecting relatively large changes; 
in addition, it has the important virtue of simplicity — a virtue that 
extends the range of economic application of 1\ into areas where alterna- 
tive tests have better statistical properties. It is difficult to recommend 
a- single alternative test to 7\ for general application, though it is clear 
that alternative tests may be profitably used in many applications 
where early detection of relatively small changes is important. 
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